How Serious Is the 'Carelessness' Problem on Mechanical Turk?

Autor/inn/en	Aruguete, Mara S.; Huynh, Ho; Browne, Blaine L.; Jurs, Bethany; Flint, Emilia; McCutcheon, Lynn E.
Titel	How Serious Is the 'Carelessness' Problem on Mechanical Turk?
Quelle	In: International Journal of Social Research Methodology, 22 (2019) 5, S.441-449 (9 Seiten) PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Aruguete, Mara S.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1364-5579
DOI	10.1080/13645579.2018.1563966
Schlagwörter	Data Collection; Research Methodology; Sampling; College Students; Online Surveys; Error Patterns; Responses; Georgia; Missouri; Kentucky; South Dakota + Suchen Sie Ihr Suchwort? Data capture; Datensammlung; Research method; Forschungsmethode; Collegestudent; Fehlertyp; South-Dakota
Abstract	This study compared the quality of survey data collected from Mechanical Turk (MTurk) workers and college students. Three groups of participants completed the same survey. "MTurk" respondents completed the survey as paid workers using the Mechanical Turk crowdsourcing platform. "Student Online" respondents also completed the survey online after having been recruited in class. Finally, "Student Paper-and-Pencil" respondents completed the survey on paper in a classroom setting. Validity checks embedded in the survey were designed to gauge participants' haste and carelessness in survey completion. MTurk respondents were significantly more likely to fail validity checks by contradicting their own answers or simply completing the survey too quickly. Student groups showed fewer careless mistakes and longer completion times. The MTurk sample tended to be older, more educated, and more ethnically diverse than student samples. Results suggest that researchers should pay special attention to the use of validity checks when recruiting MTurk samples. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01